Image Processing Method And Apparatus, And Electronic Device

ABSTRACT

An image processing method is provided. The image sensor outputs a merged image and a color-block image in a same scene. A preset target region is identified in the merged image. A part of the color-block image corresponding to a part of the merged image beyond the preset target region is converted into a first image using a first interpolation algorithm, and a part of the merged image within the preset target region is converted into a second image using a second interpolation algorithm. The first image and the second image are merged into a simulation image. An image processing apparatus and an electronic device are provided. With the image processing method and apparatus, and the electronic device the situation that the image sensor needs to take a long work to output a high quality image can be avoided, thus reducing the work time and improving the work efficiency.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on and claims priority of Chinese PatentApplication No. 201611078876.3 filed on Nov. 29, 2016, the entirecontents of which are incorporated herein by reference.

FIELD

The present disclosure relates to the image processing technology, andmore particularly to an image processing method, an image processingapparatus and an electronic device.

BACKGROUND

When an image is processed using a conventional image processing method,either the obtained image has a low resolution, or it takes a long timeand too much resource to obtain an image with high resolution, both ofwhich are inconvenient for users. Moreover, in a practical application,performing a high-resolution processing on a certain part may reduceuser experience.

DISCLOSURE

The present disclosure aims to solve at least one of existing problemsin the related art to at least some extent. Accordingly, the presentdisclosure provides an image processing method, an image processingapparatus and an electronic device.

Embodiments of the present disclosure provide an image processingmethod. The image processing method is applied in an electronic device.The electronic device includes an image sensor, the image sensorincludes an array of photosensitive pixel units and an array of filterunits arranged on the array of photosensitive pixel units. Each filterunit corresponds to one photosensitive pixel unit, and eachphotosensitive pixel unit includes a plurality of photosensitive pixels.The image processing method includes: outputting a merged image and acolor-block image by the image sensor in a same scene, in which, themerged image includes an array of merged pixels, and the photosensitivepixels in a same photosensitive pixel unit are collectively output asone merged pixel, the color-block image includes image pixel unitsarranged in a preset array, each image pixel unit includes a pluralityof original pixels, each photosensitive pixel unit corresponds to oneimage pixel unit, and each photosensitive pixel corresponds to oneoriginal pixel; identifying a preset target region in the merged image;converting a part of the color-block image corresponding to a part ofthe merged image beyond the preset target region into a first imageusing a first interpolation algorithm, in which, the first imageincludes first simulation pixels arranged in an array, and eachphotosensitive pixel corresponds to one first simulation pixel;converting a part of the merged image within the preset target regioninto a second image using a second interpolation algorithm, in which,the second image includes second simulation pixels arranged in an array,and each photosensitive pixel corresponds to one second simulationpixel, and a complexity of the second interpolation algorithm is lessthan that of the first interpolation algorithm; and merging the firstimage and the second image into a simulation image.

Embodiments of the present disclosure further provide an imageprocessing apparatus. The image processing apparatus is applied in anelectronic device. The electronic device includes an image sensor, andthe image sensor includes an array of photosensitive pixel units and anarray of filter units arranged on the array of photosensitive pixelunits. Each filter unit corresponds to one photosensitive pixel unit,and each photosensitive pixel unit includes a plurality ofphotosensitive pixels. The image processing apparatus includes anon-transitory computer-readable medium including computer-readableinstructions stored thereon, and an instruction execution system whichis configured by the instructions to implement at least one of an outputmodule, an identifying module, a first converting module, a secondconverting module, and a merging module. The output module is configuredto output a merged image and a color-block image by the image sensor ina same scene, in which, the merged image includes an array of mergedpixels, and the photosensitive pixels in a same photosensitive pixelunit are collectively output as one merged pixel, the color-block imageincludes image pixel units arranged in a preset array, each image pixelunit includes a plurality of original pixels, each photosensitive pixelunit corresponds to one image pixel unit, and each photosensitive pixelcorresponds to one original pixel. The identifying module is configuredto identify a preset target region in the merged image. The firstconverting module is configured to convert a part of the color-blockimage corresponding to a part of the merged image beyond the presettarget region into a first image using a first interpolation algorithm,in which, the first image includes first simulation pixels arranged inan array, and each photosensitive pixel corresponds to one firstsimulation pixel. The second converting module is configured to converta part of the merged image within the preset target region into a secondimage using a second interpolation algorithm, in which, the second imageincludes second simulation pixels arranged in an array, and eachphotosensitive pixel corresponds to one second simulation pixel, and acomplexity of the second interpolation algorithm is less than that ofthe first interpolation algorithm. The merging module is configured tomerge the first image and the second image into a simulation image.

Embodiments of the present disclosure provide an electronic device. Theelectronic device includes a housing, a processor, a memory, a circuitboard, a power supply circuit and an imaging apparatus. The circuitboard is enclosed by the housing. The processor and the memory arepositioned on the circuit board. The power supply circuit is configuredto provide power for respective circuits or components of the electronicdevice. The imaging apparatus includes an image sensor. The image sensorincludes an array of photosensitive pixel units and an array of filterunits arranged on the array of photosensitive pixel units. Each filterunit corresponds to one photosensitive pixel unit, and eachphotosensitive pixel unit includes a plurality of photosensitive pixels.The memory is configured to store executable program codes. Theprocessor is configured to run a program corresponding to the executableprogram codes by reading the executable program codes stored in thememory, to perform the image processing method according to embodimentsof the present disclosure.

Additional aspects and advantages of embodiments of present disclosurewill be given in part in the following descriptions, become apparent inpart from the following descriptions, or be learned from the practice ofthe embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other aspects and advantages of embodiments of the presentdisclosure will become apparent and more readily appreciated from thefollowing descriptions made with reference to the drawings.

FIG. 1 is a flow chart of an image processing method according to anembodiment of the present disclosure.

FIG. 2 is a block diagram of an image sensor according to an embodimentof the present disclosure.

FIG. 3 is a schematic diagram of an image sensor according to anembodiment of the present disclosure.

FIG. 4 is a schematic diagram illustrating a process of merging a firstimage and a second image according to an embodiment of the presentdisclosure.

FIG. 5 is a flow chart showing a process of converting a part of thecolor-block image into a first image according to an embodiment of thepresent disclosure.

FIG. 6 is a schematic diagram illustrating a circuit of an image sensoraccording to an embodiment of the present disclosure.

FIG. 7 is a schematic diagram of an array of filter units according toan embodiment of the present disclosure.

FIG. 8 is a schematic diagram of a merged image according to anembodiment of the present disclosure.

FIG. 9 is a schematic diagram of a color-block image according to anembodiment of the present disclosure.

FIG. 10 is a schematic diagram illustrating a process of converting acolor-block image into a first image according to an embodiment of thepresent disclosure.

FIG. 11 is a flow chart illustrating a process of converting a part ofthe color-block image into a first image according to another embodimentof the present disclosure.

FIG. 12 is a flow chart illustrating a process of converting a part ofthe color-block image into a first image according to another embodimentof the present disclosure.

FIG. 13 is a flow chart illustrating a process of converting a part ofthe color-block image into a first image according to another embodimentof the present disclosure.

FIG. 14 is a block diagram of an image processing apparatus according toan embodiment of the present disclosure.

FIG. 15 is a block diagram of a first converting module according to anembodiment of the present disclosure.

FIG. 16 is a block diagram of a third determining unit in the firstconverting module according to an embodiment of the present disclosure.

FIG. 17 is a block diagram of a first converting module according toanother embodiment of the present disclosure.

FIG. 18 is a block diagram of a first converting module according toanother embodiment of the present disclosure.

FIG. 19 is a block diagram of an electronic device according to anembodiment of the present disclosure.

EMBODIMENTS OF THE PRESENT DISCLOSURE

Reference will now be made in detail to exemplary embodiments, examplesof which are illustrated in the accompanying drawings, in which the sameor similar reference numbers throughout the drawings represent the sameor similar elements or elements having same or similar functions.Embodiments described below with reference to drawings are merelyexemplary and used for explaining the present disclosure, and should notbe understood as limitation to the present disclosure.

Various embodiments and examples are provided in the followingdescription to implement different structures of the present disclosure.In order to simplify the present disclosure, certain elements andsettings will be described. However, these elements and settings areonly examples and are not intended to limit the present disclosure. Inaddition, reference numerals may be repeated in different examples inthe disclosure. This repeating is for the purpose of simplification andclarity and does not refer to relations between different embodimentsand/or settings. Furthermore, examples of different processes andmaterials are provided in the present disclosure. However, it would beappreciated by those skilled in the art that other processes and/ormaterials may be also applied.

In the related art, an image sensor includes an array of photosensitivepixel units and an array of filter units arranged on the array ofphotosensitive pixel unit. Each filter unit corresponds to and coversone photosensitive pixel unit, and each photosensitive pixel unitincludes a plurality of photosensitive pixels. When working, the imagesensor is controlled to output a merged image, which can be convertedinto a merged true-color image by an image processing method and saved.The merged image includes an array of merged pixels, and a plurality ofphotosensitive pixels in a same photosensitive pixel unit arecollectively outputted as one merged pixel. Thus, a signal-to-noiseratio of the merge image is increased. However, a resolution of themerged image is reduced.

Certainly, the image sensor can be controlled to output a high pixelcolor-block image, which includes an array of original pixels, and eachphotosensitive pixel corresponds to one original pixel. However, since aplurality of original pixels corresponding to a same filter unit havethe same color, the resolution of the color-block image still cannot beincreased. Thus, the high pixel color-block image needs to be convertedinto a high pixel simulation image by an interpolation algorithm, inwhich the simulation image includes a Bayer array of simulation pixels.Then, the simulation image can be converted into a simulation true-colorimage by an image processing method and saved. However, theinterpolation algorithm consumes resource and time, and the simulationtrue-color image is not required in all scenes.

Thus, embodiments of the present disclosure provide a novel imageprocessing method.

Referring to FIG. 1, an image processing method is illustrated. Theimage processing method is applied in an electronic device. Theelectronic device includes an imaging apparatus including an imagesensor. As illustrated in FIGS. 2 and 3, the image sensor 200 includesan array 210 of photosensitive pixel units and an array 220 of filterunits arranged on the array 210 of photosensitive pixel units. Eachfilter unit 220 a corresponds to one photosensitive pixel unit 210 a. Inat least one embodiment, there is a one-to-one correspondence betweenthe filter units and the photosensitive pixel units. Each photosensitivepixel unit 210 a includes a plurality of photosensitive pixels 212. Theimage processing method includes the following.

At block 10, the image sensor outputs a merged image and a color-blockimage in a same scene.

The merged image includes an array of merged pixels, and thephotosensitive pixels in a same photosensitive pixel unit arecollectively output as one merged pixel. The color-block image includesimage pixel units arranged in a preset array, each image pixel unitincludes a plurality of original pixels, each photosensitive pixel unitcorresponds to one image pixel unit. In at least one embodiment, thereis a one-to-one correspondence between the photosensitive pixel unitsand the image pixel units. Each photosensitive pixel corresponds to oneoriginal pixel. In at least one embodiment, there is a one-to-onecorrespondence between the photosensitive pixels and the originalpixels.

At block 20, a preset target region is identified in the merged image.

At block 30, a part of the color-block image corresponding to a part ofthe merged image beyond the preset target region is converted into afirst image using a first interpolation algorithm.

The first image includes first simulation pixels arranged in an array,and each photosensitive pixel corresponds to one first simulation pixel.In at least one embodiment, there is a one-to-one correspondence betweenthe photosensitive pixels and the first simulation pixels.

The preset target region may refer to a region including a targetobject, such as a human face.

At block 40, a part of the merged image within the preset target regionis converted into a second image using a second interpolation algorithm.

The second image includes second simulation pixels arranged in an array,and each photosensitive pixel corresponds to one second simulationpixel. In at least one embodiment, there is a one-to-one correspondencebetween the photosensitive pixels and the second simulation pixels. Acomplexity of the second interpolation algorithm is less than that ofthe first interpolation algorithm.

At block 50, the first image and the second image are merged into asimulation image.

With the image processing method according to embodiments of the presentdisclosure, the first interpolation algorithm is adopted for the part ofthe color-block image corresponding to a part of the merged image beyondthe preset target region so as to improve distinguishability andresolution of the image beyond the preset target region, and the secondinterpolation algorithm with complexity less than that of the firstinterpolation algorithm is adopted for the part of the merged imagewithin the preset target region, the algorithm complexity includes thetime complexity and the space complexity, such that SNR (signal to noiseratio), distinguishability and resolution of the image are improved, andtime required for image processing is reduced, thereby improving userexperience.

Since the first interpolation algorithm is adopted for the part of thecolor-block image corresponding to a part of the merged image beyond thepreset target region, the second interpolation algorithm is adopted forthe part of the merged image within the preset target region (the secondinterpolation algorithm has a complexity including the time complexityand the space complexity both less than those of the first interpolationalgorithm), only a part of the image is processed using the firstinterpolation algorithm with greater complexity, such that the timerequired for image processing is reduced and quality of the part of theimage is improved. Meanwhile, the part of the image within the presettarget region (such as a region having a human face) has a lowerdistinguishability than the part of the image beyond the preset targetregion, thus the user obtains a better shooting experience.

Referring to FIG. 4, a process of merging the first image and the secondimage is illustrated. A part of the color-block image corresponding to apart of the merged image beyond the preset target region is processedusing the first interpolation algorithm to acquire the first image, andthe merged image within the preset target region is processed using thesecond interpolation algorithm to acquire the second image, and then thefirst image and the second image are merged into a simulation image. Inthis way, a part of the simulation image beyond the preset target regionhas a high resolution.

Referring to FIG. 5, in some implementations, the act at block 30includes the following.

At block 31, it is determined whether a color of a first simulationpixel is identical to that of an original pixel at a same position asthe first simulation pixel, if yes, an act at block 32 is executed,otherwise, an act at block 33 is executed.

At block 32, a pixel value of the original pixel is determined as apixel value of the first simulation pixel.

At block 33, the pixel value of the first simulation pixel is determinedaccording to a pixel value of an association pixel.

The association pixel is selected from an image pixel unit with a samecolor as the first simulation pixel and adjacent to an image pixel unitincluding the original pixel.

FIG. 6 is a schematic diagram illustrating a circuit of an image sensoraccording to an embodiment of the present disclosure. FIG. 7 is aschematic diagram of an array of filter units according to an embodimentof the present disclosure. FIGS. 2-3 and 6-7 are better viewed together.

Referring to FIGS. 2-3 and 6-7, the image sensor 200 according to anembodiment of the present disclosure includes an array 210 ofphotosensitive pixel units and an array 220 of filter units arranged onthe array 210 of photosensitive pixel units.

Further, the array 210 of photosensitive pixel units includes aplurality of photosensitive pixel units 210 a. Each photosensitive pixelunit 210 a includes a plurality of photosensitive pixels 212. Eachphotosensitive pixel 212 includes a photosensitive element 2121 and atransmission tube 2122. The photosensitive element 2121 may be aphotodiode, and the transmission tube 2122 may be a MOS transistor.

The array 220 of filter units includes a plurality of filter units 220a. Each filter unit 220 a corresponding to one photosensitive pixel unit210 a.

In detail, in some examples, the filter units are arranged in a Bayerarray. In other words, four adjacent filter units 220 a include one redfilter unit, one blue filter unit and two green filter units.

Each photosensitive pixel unit 210 a corresponds to a filter unit 220 awith a same color. If a photosensitive pixel unit 210 a includes nadjacent photosensitive elements 2121, one filter unit 220 a covers nphotosensitive elements 2121 in one photosensitive pixel unit 210 a. Thefilter unit 220 a may be formed integrally, or may be formed byassembling n separate sub filters.

In some implementations, each photosensitive pixel unit 210 a includesfour adjacent photosensitive pixels 212. Two adjacent photosensitivepixels 212 collectively form one photosensitive pixel subunit 2120. Thephotosensitive pixel subunit 2120 further includes a source follower2123 and an analog-to-digital converter 2124. The photosensitive pixelunit 210 a further includes an adder 213. A first electrode of eachtransmission tube 2122 in the photosensitive pixel subunit 2120 iscoupled to a cathode electrode of a corresponding photosensitive element2121. Second electrodes of all the transmission tubes 2122 in thephotosensitive pixel subunit 2120 are collectively coupled to a gateelectrode of the source follower 2123 and coupled to ananalog-to-digital converter 2124 via the source electrode of the sourcefollower 2123. The source follower 2123 may be a MOS transistor. Twophotosensitive pixel subunits 2120 are coupled to the adder 213 viarespective source followers 2123 and respective analog-to-digitalconverters 2124.

In other words, four adjacent photosensitive elements 2121 in onephotosensitive pixel unit 210 a of the image sensor 200 according to anembodiment of the present disclosure collectively use one filter unit220 a with a same color as the photosensitive pixel unit. Eachphotosensitive element 2121 is coupled to a transmission tube 2122correspondingly. Two adjacent photosensitive elements 2121 collectivelyuse one source follower 2123 and one analog-digital converter 2124. Fouradjacent photosensitive elements 2121 collectively use one adder 213.

Further, four adjacent photosensitive elements 2121 are arranged in a2-by-2 array. Two photosensitive elements 2121 in one photosensitivepixel subunit 2120 can be in a same row.

During an imaging process, when two photosensitive pixel subunits 2120or four photosensitive elements 2121 covered by a same filter unit 220 aare exposed simultaneously, pixels can be merged, and the merged imagecan be outputted.

In detail, the photosensitive element 2121 is configured to convertlight into charge, and the charge is proportional to an illuminationintensity. The transmission tube 2122 is configured to control a circuitto turn on or off according to a control signal. When the circuit isturned on, the source follower 2123 is configured to convert the chargegenerated through light illumination into a voltage signal. Theanalog-to-digital converter 2124 is configured to convert the voltagesignal into a digital signal. The adder 213 is configured to add twodigital signals for outputting.

Referring to FIG. 8, take an image sensor 200 of 16M as an example. Theimage sensor 200 according to an embodiment of the present disclosurecan merge photosensitive pixels 212 of 16M into photosensitive pixels of4M, the image sensor 200 outputs the merged image. After the merging,the photosensitive pixel 212 quadruples in size, such that thephotosensibility of the photosensitive pixel 212 is increased. Inaddition, since most part of noise in the image sensor 200 is random,there may be noise points at one or two pixels. After fourphotosensitive pixels 212 are merged into a big photosensitive pixel212, an effect of noise points on the big photosensitive pixel isreduced, thus, the noise is weakened and SNR (signal to noise ratio) isimproved.

However, when the size of the photosensitive pixel 212 is increased, thepixel value is decreased, and thus the resolution of the merged image isdecreased.

During an imaging process, when four photosensitive elements 2121covered by a same filter unit 220 a are exposed in sequence, acolor-block image is output.

In detail, the photosensitive element 2121 is configured to convertlight into charge, and the charge is proportional to an illuminationintensity. The transmission tube 2122 is configured to control a circuitto turn on or off according to a control signal. When the circuit isturned on, the source follower 2123 is configured to convert the chargegenerated through light illumination into a voltage signal. Theanalog-to-digital converter 2124 is configured to convert the voltagesignal into a digital signal.

Referring to FIG. 9, take an image sensor 200 of 16M as an example. Theimage sensor according to an embodiment of the present disclosure canoutput photosensitive pixels 212 of 16M, the image sensor 200 outputsthe color-block image. The color-block image includes image pixel units.The image pixel unit includes original pixels arranged in a 2-by-2array. The size of the original pixel is the same as that of thephotosensitive pixel 212. However, since a filter unit 220 a coveringfour adjacent photosensitive elements 2121 has a same color (althoughfour photosensitive elements 2121 are exposed respectively, the filterunit 220 a covering the four photosensitive elements has a same color),four adjacent original pixels in each image pixel unit of the outputimage have a same color, and thus the resolution of the image cannot beincreased.

The image processing method according to an embodiment of the presentdisclosure is able to process the output color-block image to obtain asimulation image.

In some embodiments, when a merged image is output, four adjacentphotosensitive pixels 212 with the same color can be output as onemerged pixel. Accordingly, four adjacent merged pixels in the mergedimage can be considered as being arranged in a typical Bayer array, andcan be processed directly to output a merged true-color image. When acolor-block image is output, each photosensitive pixel 212 is outputseparately. Since four adjacent photosensitive pixels 212 have a samecolor, four adjacent original pixels in an image pixel unit have a samecolor, which form an untypical Bayer array. However, the untypical Bayerarray cannot be directly processed. In other words, when the imagesensor 200 adopts a same apparatus for processing the image, in order torealize a compatibility of the true-color image outputs under two modes(the merged true-color image under a merged mode and the simulationtrue-color image under a color-block mode), it is required to convertthe color-block image into the simulation image, or to convert the imagepixel unit in an untypical Bayer array into pixels arranged in thetypical Bayer array.

The simulation image includes simulation pixels arranged in the Bayerarray. Each photosensitive pixel corresponds to one simulation pixel.One simulation pixel in the simulation image corresponds to an originalpixel located at the same position as the simulation pixel and in thecolor-block image. According to embodiments of the present disclosure,the simulation image is merged by the first image and the second image.By using the first interpolation algorithm, the part of the color-blockimage corresponding to a part of the merged image beyond the presettarget region can be coveted into the first image. The first imageincludes first simulation pixels arranged in an array and eachphotosensitive pixel corresponds to one first simulation pixel.

With the image processing method, the color-block image and the mergedimage are outputted respectively, and a preset target region such as ahuman face region is identified in the merged image. Based on acorrespondence between the color-block image and the merged image, apart of the color-block image beyond the preset target region isconverted into a Bayer array, and processed using the firstinterpolation algorithm.

FIG. 10 is a schematic diagram illustrating a process of converting acolor-block image into a first image according to an embodiment of thepresent disclosure.

Referring to FIG. 10, for the first simulation pixels R3′3′ and R5′5′,the corresponding original pixels are R33 and B55.

When the first simulation pixel R3′3′ is obtained, since the firstsimulation pixel R3′3′ has the same color as the corresponding originalpixel R33, the pixel value of the original pixel R33 is directlydetermined as the pixel value of the first simulation pixel R3′3′ duringconversion.

When the first simulation pixel R5′5′ is obtained, since the firstsimulation pixel R5′5′ has a color different from that of thecorresponding original pixel B55, the pixel value of the original pixelB55 cannot be directly determined as the pixel value of the firstsimulation pixel R5′5′, and it is required to calculate the pixel valueof the first simulation pixel R5′5′ according to an association pixel ofthe first simulation pixel R5′5′ by a first interpolation algorithm.

It should be noted that, a pixel value of a pixel mentioned in thecontext should be understood in a broad sense as a color attribute valueof the pixel, such as a color value.

There may be more than one association pixel unit including theassociation pixels for each first simulation pixel, for example, theremay be four association pixel units, in which the association pixelunits have the same color as the first simulation pixel and are adjacentto the image pixel unit including the original pixel at the sameposition as the first simulation pixel.

It should be noted that, “adjacent” here should be understood in a broadsense. Take FIG. 10 as an example, the first simulation pixel R5′5′corresponds to the original pixel B55. The image pixel units 400, 500,600 and 700 are selected as the association pixel units, but other redimage pixel units far away from the image pixel unit where the originalpixel B55 is located are not selected as the association pixel units. Ineach association pixel unit, the red original pixel closest to theoriginal pixel B55 is selected as the association pixel, which meansthat the association pixels of the first simulation pixel R5′5′ includethe original pixels R44, R74, R47 and R77. The first simulation pixelR5′5′ is adjacent to and has the same color as the original pixels R44,R74, R47 and R77.

In different cases, the original pixels can be converted into the firstsimulation pixels in different ways, thus converting the color-blockimage into the first image. Since the filters in the Bayer array areadopted when shooting the image, the SNR of the image is improved.During the image processing procedure, the interpolation processing isperformed on the color-block image by the first interpolation algorithm,such that the distinguishability and resolution of the image can beimproved.

Referring to FIG. 11, in some implementations, the act at block 33(determining the pixel value of the first simulation pixel according tothe pixel value of the association pixel) includes the following.

At block 331, a change of the color of the first simulation pixel ineach direction of at least two directions is calculated according to thepixel value of the association pixel.

At block 332, a weight in each direction of the at least two directionsis calculated according to the change.

At block 333, the pixel value of the first simulation pixel iscalculated according to the weight and the pixel value of theassociation pixel.

In detail, the first interpolation algorithm is realized as follows:with reference to energy changes of the image in different directionsand according to weights of the association pixels in differentdirections, the pixel value of the first simulation pixel is calculatedby a linear interpolation. From the direction having a smaller energychange, it can get a higher reference value, thus, the weight for thisdirection in the interpolation is high.

In some examples, for sake of convenience, only the horizontal directionand the vertical direction are considered.

The pixel value of the first simulation pixel R5′5′ is obtained by aninterpolation based on the original pixels R44, R74, R47 and R77. Sincethere is no original pixel with a same color as the first simulationpixel (i.e., R) in the horizontal direction and the vertical directionof the original pixel B55 corresponding the first simulation pixelR5′5′, a component of this color (i.e., R) in each of the horizontaldirection and the vertical direction is calculated according to theassociation pixels. The components in the horizontal direction are R45and R75, the components in the vertical direction are R54 and R57. Allthe components can be calculated according to the original pixels R44,R74, R47 and R77.

In detail, R45=R44*⅔+R47*⅓, R75=⅔*R74+⅓*R77, R54=⅔*R44+⅓*R74,R57=⅔*R47+⅓*R77.

The change of color and the weight in each of the horizontal directionand the vertical direction are calculated respectively. In other words,according to the change of color in each direction, the reference weightin each direction used in the interpolation is determined. The weight inthe direction with a small change is high, while the weight in thedirection with a big change is low. The change in the horizontaldirection is X1=|R45-R75|. The change in the vertical direction isX2=|R54-R57|, W1=X1/(X1+X2), W2=X2/(X1+X2).

After the above calculation, the pixel value of the first simulationpixel R5′5′ can be calculated asR5′5′=(⅔*R45+⅓*R75)*W2+(⅔*R54+⅓*R57)*W1. It can be understood that, ifX1>X2, then W1>W2. The weight in the horizontal direction is W2, and theweight in the vertical direction is W1, vice versa.

Accordingly, the pixel value of the first simulation pixel can becalculated by the first interpolation algorithm. After the calculationson the association pixels, the original pixels can be converted into thefirst simulation pixels arranged in the typical Bayer array. In otherwords, four adjacent first simulation pixels arranged in the 2-by-2array include one red first simulation pixel, two green first simulationpixels and one blue first simulation pixel.

It should be noted that, the first interpolation algorithm is notlimited to the above-mentioned method, in which only the pixel values ofpixels with a same color as the first simulation pixel in the verticaldirection and the horizontal direction are considered during calculatingthe pixel value of the first simulation pixel. In other embodiments,pixel values of pixels with other colors can also be considered.

Referring to FIG. 12, in some embodiments, before the act at block 33,the method further includes performing a white-balance compensation onthe color-block image, as illustrated at block 34.

Accordingly, after the act at block 33, the method further includesperforming a reverse white-balance compensation on the first image, asillustrated at block 35.

In detail, in some examples, when converting the color-block image intothe first image, during the interpolation using the first interpolationalgorithm, the red and blue first simulation pixels not only refer tothe color weights of original pixels having the same color as the firstsimulation pixels, but also refer to the color weights of originalpixels with the green color. Thus, it is required to perform thewhite-balance compensation before the interpolation to exclude an effectof the white-balance in the interpolation calculation. In order to avoiddamaging the white-balance of the color-block image, it is required toperform the reverse white-balance compensation after the interpolationcalculation according to gain values of the red, green and blue colorsin the compensation.

In this way, the effect of the white-balance in the first interpolationalgorithm can be excluded, and the simulation image obtained after theinterpolation can keep the white-balance of the color-block image.

Referring to FIG. 12 again, in some implementations, before the act atblock 33, the method further includes performing a bad-pointcompensation on the color-block image, as illustrated at block 36.

It can be understood that, limited by the manufacturing process, theremay be bad points in the image sensor 200. The bad point presents a samecolor all the time without varying with the photosensibility, whichaffects quality of the image. In order to ensure an accuracy of theinterpolation and prevent from the effect of the bad points, it isrequired to perform the bad-point compensation before the firstinterpolation algorithm is performed.

In detail, during the bad-point compensation, the original pixels aredetected. When an original pixel is detected as the bad point, thebad-point compensation is performed according to pixel values of otheroriginal pixels in the image pixel unit where the original pixel islocated.

In this way, the effect of the bad point on the interpolation can beavoided, thus improving the quality of the image.

Referring to FIG. 12 again, in some implementations, before the act atblock 33, the method includes performing a crosstalk compensation on thecolor-block image, as illustrated at block 37.

In detail, four photosensitive pixels 212 in one photosensitive pixelunit 210 a cover the filters with the same color, and the photosensitivepixels 212 have differences in photosensibility, such that fixedspectrum noise may occur in pure-color areas in the first true-colorimage outputted after converting the first image and the quality of theimage may be affected. Therefore, it is required to perform thecrosstalk compensation.

Referring to FIG. 13, in some implementations, after the act at block33, the method further includes performing at least one of a mirrorshape correction, a demosaicking processing, a denoising processing andan edge sharpening processing on the first image, as illustrated atblock 38.

It can be understood that, after the color-block image is converted intothe first image, the first simulation pixels are arranged in the typicalBayer array. The first image can be processed, during which, the mirrorshape correction, the demosaicking processing, the denoising processingand the edge sharpening processing are included, such that the firsttrue-color image can be obtained and output to the user.

For the merged image, referring to FIG. 8, since the merged image is nota typical Bayer array, the image sensor 200 merges the photosensitivepixels of 16M into pixels of 4M for directly outputting. Thus, in orderto facilitate the merging of the color-block image and the merged image,it is required to process the merged image using the secondinterpolation algorithm to enlarge the merged image and convert themerged image into a restoration image which is the same in size as thecolor-block image.

In another aspect, the present disclosure also provides an imageprocessing apparatus.

FIG. 14 is a block diagram of an image processing apparatus according toan embodiment of the present disclosure. Referring to FIG. 14 and FIGS.2-3 and 6-7, an image processing apparatus 4000 is illustrated. Theimage processing apparatus 4000 is applied in an electronic device. Asillustrated above, the electronic device includes an imaging apparatusincluding an image sensor 200, the image sensor 200 includes an array210 of photosensitive pixel units and an array 220 of filter unitsarranged on the array 210 of photosensitive pixel units. Each filterunit 220 a corresponds to one photosensitive pixel unit 210 a, and eachphotosensitive pixel unit 210 a includes a plurality of photosensitivepixels 212. The image processing apparatus 4000 includes anon-transitory computer-readable medium 4600 and an instructionexecution system 4800. The non-transitory computer-readable medium 4600includes computer-executable instructions stored thereon. As illustratedin FIG. 14, the non-transitory computer-readable medium 4600 includes aplurality of program modules, including an output module 410, anidentifying module 420, a first converting module 430, a secondconverting module 440 and a merging module 450. The instructionexecution system 4800 is configured by the instructions stored in themedium 4600 to implement the program modules.

The output module 410 is configured to output a merged image and acolor-block image by the image sensor in a same scene, in which, themerged image includes an array of merged pixels, and the photosensitivepixels in a same photosensitive pixel unit are collectively output asone merged pixel, the color-block image includes image pixel unitsarranged in a preset array, each image pixel unit includes a pluralityof original pixels, each photosensitive pixel unit corresponds to oneimage pixel unit, and each photosensitive pixel corresponds to oneoriginal pixel. The identifying module 420 is configured to identify apreset target region in the merged image. The first converting module430 is configured to convert a part of the color-block imagecorresponding to a part of the merged image beyond the preset targetregion into a first image using a first interpolation algorithm, inwhich, the first image includes first simulation pixels arranged in anarray, and each photosensitive pixel corresponds to one first simulationpixel. The second converting module 440 is configured to convert a partof the merged image within the preset target region into a second imageusing a second interpolation algorithm, in which, the second imageincludes second simulation pixels arranged in an array, and eachphotosensitive pixel corresponds to one second simulation pixel, and acomplexity of the second interpolation algorithm is less than that ofthe first interpolation algorithm. The merging module 450 is configuredto merge the first image and the second image into a simulation image.

In other words, the act at block 10 can be implemented by the outputmodule 410. The act at block 20 can be implemented by the identifyingmodule 420. The act at block 30 can be implemented by the firstconverting module 430. The act at block 40 can be implemented by thesecond converting module 440. The act at block 50 can be implemented bythe merging module 450.

With the image processing apparatus according to embodiments of thepresent disclosure, the first interpolation algorithm is adopted for thepart of the color-block image corresponding to a part of the mergedimage beyond the preset target regions such as the human face region soas to improve distinguishability and resolution of the image beyond thepreset target region, and the second interpolation algorithm withcomplexity less than that of the first interpolation algorithm isadopted for the part of the merged image beyond the preset targetregion, the algorithm complexity includes the time complexity and thespace complexity, such that SNR (signal to noise ratio),distinguishability and resolution of the image are improved, and timerequired for image processing is reduced, thereby improving userexperience.

Referring to FIG. 15, in some implementations, the first convertingmodule 430 includes a first determining unit 431, a second determiningunit 432 and a third determining unit 433. The act at block 31 can beimplemented by the first determining unit 431. The act at block 32 canbe implemented by the second determining unit 432. The act at block 33can be implemented by the third determining unit 433. In other words,the first determining unit 431 is configured to determine whether acolor of a first simulation pixel is identical to that of an originalpixel at a same position as the first simulation pixel. The seconddetermining unit 432 is configured to determine a pixel value of theoriginal pixel as a pixel value of the first simulation pixel when thecolor of the first simulation pixel is identical to that of the originalpixel at the same position as the first simulation pixel. The thirddetermining unit 433 is configured to determine the pixel value of thefirst simulation pixel according to a pixel value of an associationpixel when the color of the first simulation pixel is different fromthat of the original pixel at the same position as the first simulationpixel. The association pixel is selected from an image pixel unit with asame color as the first simulation pixel and adjacent to an image pixelunit including the original pixel.

Referring to FIG. 16, in some implementations, the third determiningunit 433 further includes a first calculating subunit 4331, a secondcalculating subunit 4332 and a third calculating subunit 4333. The actat block 331 can be implemented by the first calculating subunit 4331.The act at block 332 can be implemented by the second calculatingsubunit 4332. The act at block 333 can be implemented by the thirdcalculating subunit 4333. In other words, the first calculating subunit4331 is configured to calculate a change of the color of the firstsimulation pixel in each direction of at least two directions accordingto the pixel value of the association pixel. The second calculatingsubunit 4332 is configured to calculate a weight in each direction ofthe at least two directions according to the change. The thirdcalculating subunit 4333 is configured to calculate the pixel value ofthe first simulation pixel according to the weight and the pixel valueof the association pixel.

Referring to FIG. 17, in some implementations, the first convertingmodule 430 further includes a first compensating unit 434 and arestoring unit 435. The act at block 34 can be implemented by the firstcompensating unit 434. The act at block 35 can be implemented by therestoring unit 435. In other words, the first compensating unit 434 isconfigured to perform a white-balance compensation on the color-blockimage. The restoring unit 435 is configured to perform a reversewhite-balance compensation on the first image.

In some implementations, the first converting module 430 furtherincludes a second compensating unit 436. The act at block 36 can beimplemented by the second compensating unit 436. In other words, thesecond compensating unit 436 is configured to perform a bad-pointcompensation on the color-block image.

In some implementations, the first converting module 430 furtherincludes a third compensating unit 437. The act at block 37 can beimplemented by the third compensating unit 437. In other words, thethird compensating unit 437 is configured to perform a crosstalkcompensation on the color-block image.

FIG. 18 is a block diagram of a first converting module according toanother embodiment of the present disclosure. Referring to FIG. 18, insome implementations, the first converting module 430 includes aprocessing unit 438. The act at block 38 can be implemented by theprocessing unit 438. In other words, the processing unit 438 isconfigured to perform at least one of a mirror shape correction, ademosaicking processing, a denoising processing and an edge sharpeningprocessing on the first image.

The present disclosure also provides an electronic device.

FIG. 19 is a block diagram of an electronic device 1000 according to anembodiment of the present disclosure. Referring to FIG. 19, theelectronic device 1000 of the present disclosure includes a housing1001, a processor 1002, a memory 1003, a circuit board 1006, a powersupply circuit 1007 and an imaging apparatus 100, The circuit board 1006is enclosed by the housing 1001. The processor 1002 and the memory 1003are positioned on the circuit board 1006. The power supply circuit 1007is configured to provide power for respective circuits or components ofthe electronic device 1000. The memory 1003 is configured to storeexecutable program codes. The imaging apparatus 100 includes an imagesensor 200. As illustrated above, the image sensor 200 includes an array210 of photosensitive pixel units and an array 220 of filter unitsarranged on the array 210 of photosensitive pixel units. Each filterunit 220 a corresponds to one photosensitive pixel unit 210 a. In atleast one embodiment, there is a one-to-one correspondence between thefilter units and the photosensitive pixel units. Each photosensitivepixel unit 210 a includes a plurality of photosensitive pixels 212.

The processor 1002 is configured to run a program corresponding to theexecutable program codes by reading the executable program codes storedin the memory 1003, to perform following operations: outputting a mergedimage and a color-block image by the image sensor in a same scene, inwhich, the merged image includes an array of merged pixels, and thephotosensitive pixels in a same photosensitive pixel unit arecollectively output as one merged pixel, the color-block image includesimage pixel units arranged in a preset array, each image pixel unitincludes a plurality of original pixels, each photosensitive pixel unitcorresponds to one image pixel unit, and each photosensitive pixelcorresponds to one original pixel; identifying a preset target region inthe merged image; converting a part of the color-block imagecorresponding to a part of the merged image beyond the preset targetregion into a first image using a first interpolation algorithm, inwhich, the first image includes first simulation pixels arranged in anarray, and each photosensitive pixel corresponds to one first simulationpixel; converting a part of the merged image within the preset targetregion into a second image using a second interpolation algorithm, inwhich, the second image includes second simulation pixels arranged in anarray, and each photosensitive pixel corresponds to one secondsimulation pixel, and a complexity of the second interpolation algorithmis less than that of the first interpolation algorithm; and merging thefirst image and the second image into a simulation image.

In some implementations, the imaging apparatus includes a front cameraor a real camera (not illustrated in FIG. 19).

In some implementations, the electronic device 1000 further includes atouch screen 1008.

In some implementations, the processor 1002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory 1003, to convert the partof the color-block image corresponding to the part of the merged imagebeyond the preset target region into the first image using a firstinterpolation algorithm by acts of: determining whether a color of afirst simulation pixel is identical to that of an original pixel at asame position as the first simulation pixel; when the color of the firstsimulation pixel is identical to that of the original pixel at the sameposition as the first simulation pixel, determining a pixel value of theoriginal pixel as a pixel value of the first simulation pixel; and whenthe color of the first simulation pixel is different from that of theoriginal pixel at the same position as the first simulation pixel,determining the pixel value of the first simulation pixel according to apixel value of an association pixel, in which the association pixel isselected from an image pixel unit with a same color as the firstsimulation pixel and adjacent to an image pixel unit including theoriginal pixel.

In some implementations, the processor 1002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory 1003, to determine thepixel value of the first simulation pixel according to the pixel valueof the association pixel by acts of: calculating a change of the colorof the first simulation pixel in each direction of at least twodirections according to the pixel value of the association pixel;calculating a weight in each direction of the at least two directionsaccording to the change; and calculating the pixel value of the firstsimulation pixel according to the weight and the pixel value of theassociation pixel.

In some implementations, the processor 1002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory 1003, to perform followingoperations: performing a white-balance compensation on the color-blockimage; and performing a reverse white-balance compensation on the firstimage.

In some implementations, the processor 1002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory 1003, to perform followingoperations: performing at least one of a bad-point compensation and acrosstalk compensation on the color-block image.

In some implementations, the processor 1002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory 1003, to perform followingoperations: performing at least one of a mirror shape correction, ademosaicking processing, a denoising processing and an edge sharpeningprocessing on the first image.

In some implementations, the electronic device may be an electronicequipment provided with an imaging apparatus, such as a mobile phone ora tablet computer, which is not limited herein.

The electronic device 1000 may further include an inputting component(not illustrated in FIG. 19). It should be understood that, theinputting component may further include one or more of the following: aninputting interface, a physical button of the electronic device 1000, amicrophone, etc.

It should be understood that, the electronic device 1000 may furtherinclude one or more of the following components (not illustrated in FIG.19): an audio component, an input/output (I/O) interface, a sensorcomponent and a communication component. The audio component isconfigured to output and/or input audio signals, for example, the audiocomponent includes a microphone. The I/O interface is configured toprovide an interface between the processor 1002 and peripheral interfacemodules. The sensor component includes one or more sensors to providestatus assessments of various aspects of the electronic device 1000. Thecommunication component is configured to facilitate communication, wiredor wirelessly, between the electronic device 1000 and other devices.

It is to be understood that phraseology and terminology used herein withreference to device or element orientation (such as, terms like“center”, “longitudinal”, “lateral”, “length”, “width”, “height”, “up”,“down”, “front”, “rear”, “left”, “right”, “vertical”, “horizontal”,“top”, “bottom”, “inside”, “outside”, “clockwise”, “anticlockwise”,“axial”, “radial”, “circumferential”) are only used to simplifydescription of the present invention, and do not indicate or imply thatthe device or element referred to must have or operated in a particularorientation. They cannot be seen as limits to the present disclosure.

Moreover, terms of “first” and “second” are only used for descriptionand cannot be seen as indicating or implying relative importance orindicating or implying the number of the indicated technical features.Thus, the features defined with “first” and “second” may comprise orimply at least one of these features. In the description of the presentdisclosure, “a plurality of” means two or more than two, unlessspecified otherwise.

In the present disclosure, unless specified or limited otherwise, theterms “mounted,” “connected,” “coupled,” “fixed” and the like are usedbroadly, and may be, for example, fixed connections, detachableconnections, or integral connections; may also be mechanical orelectrical connections; may also be direct connections or indirectconnections via intervening structures; may also be inner communicationsof two elements or interactions of two elements, which can be understoodby those skilled in the art according to specific situations.

In the present disclosure, unless specified or limited otherwise, astructure in which a first feature is “on” a second feature may includean embodiment in which the first feature directly contacts the secondfeature, and may also include an embodiment in which the first featureindirectly contacts the second feature via an intermediate medium.Moreover, a structure in which a first feature is “on”, “over” or“above” a second feature may indicate that the first feature is rightabove the second feature or obliquely above the second feature, or justindicate that a horizontal level of the first feature is higher than thesecond feature. A structure in which a first feature is “below”, or“under” a second feature may indicate that the first feature is rightunder the second feature or obliquely under the second feature, or justindicate that a horizontal level of the first feature is lower than thesecond feature.

Reference throughout this specification to “an embodiment,” “someembodiments,” “an example,” “a specific example,” or “some examples,”means that a particular feature, structure, material, or characteristicdescribed in connection with the embodiment or example is included in atleast one embodiment or example of the present disclosure. In thisspecification, exemplary descriptions of aforesaid terms are notnecessarily referring to the same embodiment or example. Furthermore,the particular features, structures, materials, or characteristics maybe combined in any suitable manner in one or more embodiments orexamples. Moreover, those skilled in the art could combine differentembodiments or different characteristics in embodiments or examplesdescribed in the present disclosure.

Any process or method described in a flow chart or described herein inother ways may be understood to include one or more modules, segments orportions of codes of executable instructions for achieving specificlogical functions or steps in the process, and the scope of a preferredembodiment of the present disclosure includes other implementations,wherein the order of execution may differ from that which is depicted ordiscussed, including according to involved function, executingconcurrently or with partial concurrence or in the contrary order toperform the function, which should be understood by those skilled in theart.

The logic and/or step described in other manners herein or shown in theflow chart, for example, a particular sequence table of executableinstructions for realizing the logical function, may be specificallyachieved in any computer readable medium to be used by the instructionexecution system, device or equipment (such as the system based oncomputers, the system comprising processors or other systems capable ofacquiring the instruction from the instruction execution system, deviceand equipment and executing the instruction), or to be used incombination with the instruction execution system, device and equipment.As to the specification, “the computer readable medium” may be anydevice adaptive for including, storing, communicating, propagating ortransferring programs to be used by or in combination with theinstruction execution system, device or equipment. More specificexamples of the computer-readable medium comprise but are not limitedto: an electronic connection (an electronic device) with one or morewires, a portable computer enclosure (a magnetic device), a randomaccess memory (RAM), a read-only memory (ROM), an erasable programmableread-only memory (EPROM or a flash memory), an optical fiber device anda portable compact disk read-only memory (CDROM). In addition, thecomputer-readable medium may even be a paper or other appropriate mediumcapable of printing programs thereon, this is because, for example, thepaper or other appropriate medium may be optically scanned and thenedited, decrypted or processed with other appropriate methods whennecessary to obtain the programs in an electric manner, and then theprograms may be stored in the computer memories.

It should be understood that each part of the present disclosure may berealized by hardware, software, firmware or their combination. In theabove embodiments, a plurality of steps or methods may be realized bythe software or firmware stored in the memory and executed by theappropriate instruction execution system. For example, if it is realizedby the hardware, likewise in another embodiment, the steps or methodsmay be realized by one or a combination of the following techniquesknown in the art: a discrete logic circuit having a logic gate circuitfor realizing a logic function of a data signal, an application-specificintegrated circuit having an appropriate combination logic gate circuit,a programmable gate array (PGA), a field programmable gate array (FPGA),etc.

Those skilled in the art shall understand that all or parts of the stepsin the above exemplifying method for the present disclosure may beachieved by commanding the related hardware with programs, the programsmay be stored in a computer-readable storage medium, and the programscomprise one or a combination of the steps in the method embodiments ofthe present disclosure when running on a computer.

In addition, each function cell of the embodiments of the presentdisclosure may be integrated in a processing module, or these cells maybe separate physical existence, or two or more cells are integrated in aprocessing module. The integrated module may be realized in a form ofhardware or in a form of software function modules. When the integratedmodule is realized in a form of software function module and is sold orused as a standalone product, the integrated module may be stored in acomputer-readable storage medium.

The storage medium mentioned above may be read-only memories, magneticdisks, CD, etc.

Although embodiments of present disclosure have been shown and describedabove, it should be understood that above embodiments are justexplanatory, and cannot be construed to limit the present disclosure,for those skilled in the art, changes, alternatives, and modificationscan be made to the embodiments without departing from spirit, principlesand scope of the present disclosure.

What is claimed is:
 1. An image processing method, applied in an electronic device, wherein the electronic device comprises an image sensor, the image sensor comprises an array of photosensitive pixel units and an array of filter units arranged on the array of photosensitive pixel units, each filter unit corresponds to one photosensitive pixel unit, and each photosensitive pixel unit comprises a plurality of photosensitive pixels, the image processing method comprises: outputting a merged image and a color-block image by the image sensor in a same scene, wherein, the merged image comprises an array of merged pixels, and the photosensitive pixels in a same photosensitive pixel unit are collectively output as one merged pixel, the color-block image comprises image pixel units arranged in a preset array, each image pixel unit comprises a plurality of original pixels, each photosensitive pixel unit corresponds to one image pixel unit, and each photosensitive pixel corresponds to one original pixel; identifying a preset target region in the merged image; converting a part of the color-block image corresponding to a part of the merged image beyond the preset target region into a first image using a first interpolation algorithm, wherein, the first image comprises first simulation pixels arranged in an array, and each photosensitive pixel corresponds to one first simulation pixel; converting a part of the merged image within the preset target region into a second image using a second interpolation algorithm, wherein, the second image comprises second simulation pixels arranged in an array, and each photosensitive pixel corresponds to one second simulation pixel, and a complexity of the second interpolation algorithm is less than that of the first interpolation algorithm; and merging the first image and the second image into a simulation image.
 2. The image processing method according to claim 1, wherein converting the part of the color-block image corresponding to the part of the merged image beyond the preset target region into the first image using the first interpolation algorithm comprises: determining whether a color of a first simulation pixel is identical to that of an original pixel at a same position as the first simulation pixel; when the color of the first simulation pixel is identical to that of the original pixel at the same position as the first simulation pixel, determining a pixel value of the original pixel as a pixel value of the first simulation pixel; and when the color of the first simulation pixel is different from that of the original pixel at the same position as the first simulation pixel, determining the pixel value of the first simulation pixel according to a pixel value of an association pixel, wherein the association pixel is selected from an image pixel unit with a same color as the first simulation pixel and adjacent to an image pixel unit comprising the original pixel.
 3. The image processing method according to claim 2, wherein determining the pixel value of the first simulation pixel according to the pixel value of the association pixel comprises: calculating a change of the color of the first simulation pixel in each direction of at least two directions according to the pixel value of the association pixel; calculating a weight in each direction of the at least two directions according to the change; and calculating the pixel value of the first simulation pixel according to the weight and the pixel value of the association pixel.
 4. The image processing method according to claim 1, wherein the preset array comprises a Bayer array.
 5. The image processing method according to claim 1, wherein the image pixel unit comprises original pixels arranged in an array.
 6. The image processing method according to claim 1, further comprising: performing a white-balance compensation on the color-block image; and performing a reverse white-balance compensation on the first image.
 7. The image processing method according to claim 1, further comprising: performing at least one of a bad-point compensation and a crosstalk compensation on the color-block image.
 8. The image processing method according to claim 1, further comprising: performing at least one of a mirror shape correction, a demosaicking processing, a denoising processing and an edge sharpening processing on the first image.
 9. The image processing method according to claim 1, wherein the preset target region comprises a human face.
 10. An image processing apparatus, applied in an electronic device, wherein the electronic device comprises an image sensor, the image sensor comprises an array of photosensitive pixel units and an array of filter units arranged on the array of photosensitive pixel units, each filter unit corresponds to one photosensitive pixel unit, and each photosensitive pixel unit comprises a plurality of photosensitive pixels, the image processing apparatus comprises a non-transitory computer-readable medium comprising computer-executable instructions stored thereon, and an instruction execution system which is configured by the instructions to implement at least one of: an output module, configured to output a merged image and a color-block image by the image sensor in a same scene, wherein, the merged image comprises an array of merged pixels, and the photosensitive pixels in a same photosensitive pixel unit are collectively output as one merged pixel, the color-block image comprises image pixel units arranged in a preset array, each image pixel unit comprises a plurality of original pixels, each photosensitive pixel unit corresponds to one image pixel unit, and each photosensitive pixel corresponds to one original pixel; an identifying module, configured to identify a preset target region in the merged image; a first converting module, configured to convert a part of the color-block image corresponding to a part of the merged image beyond the preset target region into a first image using a first interpolation algorithm, wherein, the first image comprises first simulation pixels arranged in an array, and each photosensitive pixel corresponds to one first simulation pixel; a second converting module, configured to convert a part of the merged image within the preset target region into a second image using a second interpolation algorithm, wherein, the second image comprises second simulation pixels arranged in an array, and each photosensitive pixel corresponds to one second simulation pixel, and a complexity of the second interpolation algorithm is less than that of the first interpolation algorithm; and a merging module, configured to merge the first image and the second image into a simulation image.
 11. The image processing apparatus according to claim 10, wherein the first converting module comprises: a first determining unit, configured to determine whether a color of a first simulation pixel is identical to that of an original pixel at a same position as the first simulation pixel; a second determining unit, configured to determine a pixel value of the original pixel as a pixel value of the first simulation pixel when the color of the first simulation pixel is identical to that of the original pixel at the same position as the first simulation pixel; and a third determining unit, configured to determine the pixel value of the first simulation pixel according to a pixel value of an association pixel when the color of the first simulation pixel is different from that of the original pixel at the same position as the first simulation pixel, wherein the association pixel is selected from an image pixel unit with a same color as the first simulation pixel and adjacent to an image pixel unit comprising the original pixel.
 12. The image processing apparatus according to claim 11, wherein the third determining unit comprises: a first calculating subunit, configured to calculate a change of the color of the first simulation pixel in each direction of at least two directions according to the pixel value of the association pixel; a second calculating subunit, configured to calculate a weight in each direction of the at least two directions according to the change; and a third calculating subunit, configured to calculate the pixel value of the first simulation pixel according to the weight and the pixel value of the association pixel.
 13. The image processing apparatus according to claim 10, wherein the preset array comprises a Bayer array.
 14. The image processing apparatus according to claim 10, wherein the image pixel unit comprises original pixels arranged in an array.
 15. The image processing apparatus according to claim 10, wherein the first converting module comprises: a first compensating unit, configured to perform a white-balance compensation on the color-block image; and a restoring unit, configured to perform a reverse white-balance compensation on the first image.
 16. The image processing apparatus according to claim 10, wherein the first converting module further comprises at least one of a second compensating unit and a third compensating unit; wherein the second compensating unit is configured to perform a bad-point compensation on the color-block image; and the third compensating unit is configured to perform a crosstalk compensation on the color-block image.
 17. The image processing apparatus according to claim 10, wherein the first converting module further comprises: a processing unit, configured to perform at least one of a mirror shape correction, a demosaicking processing, a denoising processing and an edge sharpening processing on the first image.
 18. The image processing apparatus according to claim 10, wherein the preset target region comprises a human face.
 19. An electronic device, comprising a housing, a processor, a memory, a circuit board, a power supply circuit, and an imaging apparatus, wherein, the circuit board is enclosed by the housing; the processor and the memory are positioned on the circuit board; the power supply circuit is configured to provide power for respective circuits or components of the electronic device; the imaging apparatus comprises an image sensor, wherein the image sensor comprises an array of photosensitive pixel units and an array of filter units arranged on the array of photosensitive pixel units, each filter unit corresponds to one photosensitive pixel unit, and each photosensitive pixel unit comprises a plurality of photosensitive pixels; the memory is configured to store executable program codes; and the processor is configured to run a program corresponding to the executable program codes by reading the executable program codes stored in the memory, to perform following operations: outputting a merged image and a color-block image by the image sensor in a same scene, wherein, the merged image comprises an array of merged pixels, and the photosensitive pixels in a same photosensitive pixel unit are collectively output as one merged pixel, the color-block image comprises image pixel units arranged in a preset array, each image pixel unit comprises a plurality of original pixels, each photosensitive pixel unit corresponds to one image pixel unit, and each photosensitive pixel corresponds to one original pixel; identifying a preset target region in the merged image; converting a part of the color-block image corresponding to a part of the merged image beyond the preset target region into a first image using a first interpolation algorithm, wherein, the first image comprises first simulation pixels arranged in an array, and each photosensitive pixel corresponds to one first simulation pixel; converting a part of the merged image within the preset target region into a second image using a second interpolation algorithm, wherein, the second image comprises second simulation pixels arranged in an array, and each photosensitive pixel corresponds to one second simulation pixel, and a complexity of the second interpolation algorithm is less than that of the first interpolation algorithm; and merging the first image and the second image into a simulation image.
 20. The electronic device according to claim 19, wherein the imaging apparatus comprises at least one of a rear camera and a front camera. 